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Overall  Objectives  and  this  year's  Objectives 


Overall  Objectives:  the  development  of  a  decision  support  tool  for 
reducing  the  problems  involved  with  the  storing,  sharing  and  integration 
of  subjective  information  assessments. 

Use  the  quantification  and  sharing  of  these  subjective  assessments  to 
improve  the  quality  of  group  decision  making  and  to  significantly  reduce 
the  time  devoted  to  conflict  resolution  and  team  consensus  building. 


This  year’s  objectives  are; 

(1)  the  transition  of  the  DCODE  to  the  user  community 

(2)  continued  research  to  demonstrate  the  efficacy  of  DCODE 


(3)  improved  documentation  and  publication  of  the  DCODE  tool. 
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Research  Questions  Addressed 


(1)  How  can  knowledge  elicitation  techniques  be  designed  that  capture 
the  major  subjective  information  assessments  needed  for  each 
decision-relevant  information  item  .... 

...but  does  not  place  an  unacceptable  cognitive/time  burden  on 
the  user? 

(2)  Research  indicates  that  a  minimum  set  of  3  -  6  essential 

assessments  might  be  required  for  each  item.  How  do  we  configure 
a  simplified  user  interface  that  can  score,  display  and  quantify  all 
these  required  subjective  assessments? 

(3)  In  a  group  decision  making  environment,  how  can  these  individual 

information  assessments  be  quickly  shared/transferred  among 
participants  to  minimize  the  time  the  group  devotes  to  conflict 
resolution  and  the  building  of  a  consensus. 


Technical  Approach 
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Follow  this  DCODE  process  for  all 
decision  relevant  information: 

•  Abstract 

•  Encapsulate 

•  Assess 

•  Integrate 

•  Share 

'  •  Deeide 
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DCODE  Information  Abstraction  and  Encapsulation 


Mission:  Rescue  hostages  from  Islandia 
Decision  Options:  Marines;  SEALS;  Army 
Factors:  Speed  (ETA),  Covertness,  Risk,  etc 


Situation  Assessment: 

Is  Carlos  still  in  Columbia? 


CmCPAC  emaU 

To:  LTCJolmson@cincpac.mil 
From:  steve.tliomas@noaa.gov 
Subject:  IslancUa  tides  and  currents 

HeUo  LTC  Johnson 

I  have  been  looking  at  detailed  maiine  charts  of  Islandia ’a 
reef  system.  Based  on  tliis  analysis  I  woidd  say  tliat  oidy  one 
small  section  of  the  reef  (coordinate  G17)  is  passable,  and 
tlien  only  at  PEAK  high  tide.  Tliis  will  next  occur  at  1700 
10/14.  The  word  of  caution  is  that  the  soim dings  aie  over  25 
year  s  old  and  may  have  changed  (either  for  the  better  or  the 
worse)  regai’ding  ease  of  crossmg. 


V/R 

Steve  Thomas 


Best  ETA  for 
SEALS  is  1900 
hrs,  10/14 

[P  F  00 
I  I  I  I 

Nov-2 1-05  11:33Ayl  G. 
Fleming 

ETA 


Homeland  Security  emaiL 

To:  joseph.donovan@dea.gov 
From:  wiQiam.kays@omb.gov 
Subject:  Re:  acct.  activity 

Ml’.  Donovan 

Fred  Barnes  in  Finance  Tracking  informs  me  ’witliin  the  last 
10  days,  $27K  was  deposited  in  the  referenced  account  (10/7) 
and  $25K  was  withdrawn  on  10/9.  Tliis  is  unusual  activity 
for  tliis  account 

V/R 

BiQ  Kays 


Information  is 
Abstracted, 
Encapsulated 
but  NOT 
Assessed! 


Unusual  $  activity 
in  Carlos' 
checking 
account  10/7, 10/9 

[p  1^0 

I  I  I  I 

Dec-19-05  9:03^  GM.. 
Fleming 

Money  Activity 
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DCODE  Information  Assessment 


Best  ETA  for 
SEALS  is  1900 
hrs,  10/14 

[p  p-  1^0 
I  I  I  I 

Nov-2 1-05  11:33^  G... 
Fleming 

ETA 


EWall  Information  Card 


Which  option  is  impacted? 
How  is  it  impacted? 

How  important  is  this  item? 
Quality  of  the  information? 


Timely? 


Best  ETA  for 

SEALS  is  1900 
hrs,  10/14 

r3  0  cii?  rvifi 

1 

l l U+yE^s  1 

1  Jv  V  1  “U^  1 1 . 1  U . . . 

Fleming 

ETA 

Information  Object  (lOB) 


This  DCODE  coding 

tells  me  that  this  •Negatively  impacts  the  viability 

information  using  the  seals  option. 

•Is  considered  of  high  importance. 
•There  is  some  issue  with  the  quality 
of  this  information. 
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DCODE  Information  Assessment  (cont.) 


Activating  the 
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DCODE  Assessment  Template 


Best  ETA  for 
SEALS  is  1900 
hrs,  10/14 

[P  P  ®  00 


Nov-28-05  G... 

Fleming 

ETA 
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The  Assessment  Template 


tiilviiji 


^  LOO 


Impact  Importance 

/ 


['«!■  pary 

ISEALS 


Information 

Quality 


Infor  Illation 
Imp  Oita  nee  & 
Impact 


Drop-down  menu 
for  option  selection 


D  O’  ■  1^ 


EIA  Tul 

SEALS  Is  igOD 
hirs.  iWU 

C?  P  Iff  E|a 
l_l_l  kiEy^E: 

11  D 

ETA 
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Scoring  Impact  and  Importance 


I 

M 

P 

A 

C 

T 


linpoi1;aiice 


Avei  age  Higli  Veiy  High 


Very 

Negative 

Negative 


Neutral 

Positive 

Very 

Positive 


Item  is  of  “High”  importance  (2  boxes)  and 
has  a  “Negative”  impact  (yellow)  on  this  option. 


IMPACT: 

(color) 


Very 

Positive 


Positive 


Negative 


Very 

Negative 


IMPORTANCE  (#  boxes  fiUed): 
AVERAGE  (1)  fflGH  (2)  VERY  fflGH  (3) 


Average  Iinpoitaiice  High  Impoitaiice  Veiy  High  Iinpoitaiice 

|Ve.yP,dUve  ,|V».yPo»itiv.  ^PodUv. 


Average  Iinpoitaiice 
I  Positive 


~1  I  Qptian  K 

Item  J& 


High  Impoitaiice 
I  Positive 


I  i  I  I  Option  K 

Item  F1 


Very_  High  Impoitaiice 
Positive 


I 


"2  Option  K 

Item  L6 


Average  Lnpo  italic  e 
I  Negative 


I  I  I  I  Option  K 

Item  S3 


High  Impoitaiice  Veiy  High  Impoitaiice 

I  Negative _  |  Negative 


i  I  i  Option  K 

Item  68 


Average  Lnpoitaiice  High  Impoitaiice  Veiy  High  Impoitaiice 


I  Veiy  Negative 

I  Veiy  Negative 

I  Veiy  Negative 

H  I  lOotion  K 

Option  K 

T 

Item  T7 

Item  H6 

Item  D3 
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Sample  DCODE  Assessments 


Selecting  a  House 


22  min. 

47  min. 

13’  F  ®  00 

1  1  1  1  Concord  Blvd 

13’  F  ®  00 

1  1  1  lAiams  St. 

NOV-2S-05  11:29;^  G... 
Fleming 

NOV-2S-05  11:29;^  G... 
Fleming 

Commute  time 

Commute  Time 

Parking  Lot 

Shoreline 

13’  F  ®  00 

13’  F  ®  00 

1  1  1  1  Concord  Blvd 

1  1  i  lAJams  St. 

NOV-2S-05  G... 

NOV-2S-05  G... 

Fleming 

Fleming 

View 

View 

Selecting  a  Car 


9.7  mpg 

28.1  MPG 

□J  F  00 

DJ  F  00 

H  1  1  Hummer 

I  i  I  I  Civic 

HOV-2S-05  11:24;^  G... 

Hov-28-05  11:27^^  G... 

Fleming 

Fleming 

Gas  Mileage 

Gas  Mileage 

Selecting  a  College 


[3  F  00 

13?  00 

1  1  1  1  Wisconsin 

HOV-2S-05  G... 

HOV-2S-05  11:40^  G... 

Fleming 

Fleming 

Parties 

Parties 

Single  Option: 

Buy  stock  ‘‘A”? 

87 


I  I  il  I 

Dec- 1-05  10:39/^  GM... 
Fleming 

PIE  ratio 


7.9% 


®  00 
I  I  I  I 

Dec- 1-05  10:39/^  GM... 
Fleming 

S-yr  avg.  return 


"Hold" 


®  00 
I  I  I  I 

Dec- 1-05  10:39/^  GM... 
Fleming 

Broker  rating 
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Which  is  the  BEST  option, 


SEAT.s  or  Army? 


[:?  F  Bo 
I  I  I  ISEAl^ 

Rebels  have  no 
night  vision 
capability 

I:P  p-  [^0 

I  I  I  |SE^ 

SEALS  are  very 
covert 


13)  p-  00 

I  I  I  ISEAl^ 

Seal  team  can  he 
activated 
immediately 

13  p-  00 

Seal  team  does 
not  have  a 
translator 


3  p-  00 
BESOSEAU 

SEALS  are 
especially  trained 
in  hostage  rescue 

3  p-  00 

I  I  I  ISEAi^ 

SEALS  should 
spend  least  time 
on  the  island 


3  p-  00 

1  1  1  ISEAi^ 

SEALS  have  just 
returned  from 

■snntlicir  mic-c-irkn 

3  p-  00 

1  1  1  |SEAU 

There  will  he 
dense  fog  in  the 
morning 

3  p-  00 

1  1  1  ISEAl^ 

Very  small  time 
window  for 
landing  SEALS 

3  p-  00 

1  1  1  ISEAl^ 

Injured  worker 
will  have  to  spend 

2  hours  in  Zodiac 

3  p-  00 

FSIM— ISEAL^ 

SEAL  team  has  a 
corpsman 

3  p-  00 

1  1  1  ISEAi^ 

Reef  is  only 
passable  at  high 
tide 

3  p-  00 
I  I  I  l^v 


Bridges  on  roads 
do  not  have  high 
load  capacity 


Army  will  he  the 
most  expensive 
option 


3  p-  00 
I  I  I 


3  p-  00 
I  I  I 


Army  will  have 
the  most 
firepower 


Off-road  terrain 
difficult  for  Army 
vehicles 


3  p-  00 

1  1  1  I^V 

3  p-  00 

dUnZIAmy 

Use  of  Army  will 
have  least  impact 
on  our  reserve 

Army  team 
predicted  to  have 
least  casualities 

3  p-  00 

1  1  3  I^V 

Army  team  has 
corpsman  and 
translator 

[5  F  ®  00 

1  1  riAfmv 

Army  unit  has 
trained  on  island 
and  knows  terrain 

3  p-  00 

3  p-  00 

dUnZIAmy 

Army  unit  is  very 
fresh  and  at  full 
strength 

Army  response 
will  not  be  covert 

[5  F-  ®  00 

131  F  ®  00 

Amy 

1  1  rnArniy 

Army  will  have 
the  slowest 
response  time 

Use  of  Army 
would  have  good 
public  relations 
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Integration  of  lOBs 


Fjie  VHeurs  tlEl|] 


o 

°  □ 


Soit  by  Iimpoitaiice 

aSoit  by  Impact 

I  Soil  by  Option 


ji-  •  n  0 

t  rt 


Smmnaiy  Scoiie  2D  3D 
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Sorted  by  Importance: 
Very  High  -  High  —  Average 


CP  F  ®  00 

CP  F  ®  00 

1  1  1  ISEAi^ 

1  1  1  ISEAii 

SEALS  are  very 
covert 

Rebels  have  no 
night  visia|;^^ 

CP  F  00 

F  ®  00 

1  1  a  ISEAJ^^^ 

□ZOSEALs 

ui  ^ 

especially  trained 
in  hostage  rescue 

corpsman  ^ 

CP  F  00 

F  ®  00 

1  1  1  |SEAJ4^^ 

1  1  1  ISEAl^ 

SEALS  should 
spend  least  time 
on  the  island 

Reef  is  only 
passable  at  high 

CP  F  ®  00  ^1 

•^^F®  00 

1  1  1  is^iir****^ 

1  1  1  |SE^ 

Very  small  time 
window  for 
landing  SEALS 

Seal  team  can  he 
activated 
immediately 

CP  F 


130 

SEALS 


Seal  team  does 
not  have  a 
translator 


-rnsEALs 


^There  will  be 
‘  dense  fog  in  the 
morning 


CP 


F  ®  00 

“□SEALS 


injured  worker 
ill  have  to  spend 
2  hours  in  Zodiac 


F  ®  00 
XnSEALs 

^EALS  have  just 
returned  from 

■annf  har  mic-c-inn 


Arn^^ni 
trainedwi  island 
and  know^terrain 

CP  F  00 

r~i~r 

Army  team  has 
corpsman  and 
translator 

^  00 
□  Amy 

Off-road  terrain 
difficult  for  Army 
vehicles 

<g>  00 


Most  Important  (size) 


do  not  have  high 
load  capacity 

00 
]  Amy 

Army  team 
'dieted  to  have 
le^  casualities 


inse 


will  not  be  covert 


Army  uni  Least  Important 

fresh  anil  ai  luii 


strength 


um  iiiuai 

firepower 


Use  of  Arnry  will 
have  least  impact 
on  our  reserve 


Use  of  Army 
would  have  good 
public  relations 

®  00 
]  Amy 

Army  will  be  the 
most  expensive 
option 
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Sorted  by  Impact: 

Very  Positive,  Positive,  Negative,  Very  Negative 


[P  F  ®  Elo 

[P  F  ®  00 

[P  F  ®  00 

1  1  1  ISEAL^ 

SEALS  are  very 
covert 

1  1  a  ISEAl^ 

SEAL  team  has  a 
corpsman 

1  1  3  ISEAi^ 

SEALS  are 
especially  trained 
in  hostage  rescue 

[P  F  ®  00 

1  1  1  ISEAU 

[P  F  00 

1  1  1  ISEAU 

[P  F  00 

1  1  1  ISEAU 

Rebels  have  no 
night  vision 
capability 

There  will  be 
dense  fog  in  the 
morning 

SEALS  should 
spend  least  time 
on  the  island 

[P  F  ®  00 

[P  F  ®  00 

[P  F  ®  00 

1  1  1  ISEAL^ 

1  1  1  ISEAl^ 

1  1  1  ISEAl^ 

Seal  team  can  be 
activated 
immediately 

Very  small  time 
window  for 
landing  SEALS 

Injured  worker 
will  have  to  spend 

2  hours  in  Zodiac 

[P  F  ®  00 

[P  F  00 

[P  F  00 

1  1  1  ISEAU 

Reef  is  only 
passable  at  high 
tide 

1  1  1  ISEAU 

SEALS  have  just 
returned  from 

■arifitliar  mic-c-inri 

Seal  team  does 
not  have  a 
translator 

83ker 


DCODE  Sharing 
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~1  I  Optiwi  A 
Jofies 

Item  67 


M  I  Optii^ri  B 
Jones 

Item  NASA 


I  I  I  I  Option  B 
Jones 

Item  h55 


I  I  lOction  A 
Jones 

Item  Centcom 


I  t  Option  A 
Jones 

item  HSA4 


1  1  1  1  Otrtion  A 

Olrtion  A 

1  1  1  lUEition  B 

1  1  1  lucreior  B 

Baker 

hem  HSA9 

1 

Baker 

Item  J34 

Baker 

Item  J2.8 

Baker 

l|em  58ct 

1 

*  (Otherj 
JParticipa^its) 

I  I 


(Workspace) 


I 


r^rT^i  Dptan  A 

Item  29 


item  20 


I  O^Imi  B 

Item  30 


■■■■  dDtioti  A 

ItEsm  10 

liom  4 

r  [  t  lOrtion  B 

ttem  18 


I  I  I  OptiMI  B 

Item  26 


("I*  f~iOHion  fl 

Mem  32 


Item  13 


^dpcim  6 

Item  14 


Smith’s  Display  (EWall  workspace  +  Exchange  view) 
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Making  Decisions  with  DCODE 


The  Weighting/Scoring  matrix 
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IMPORTANCE 
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1 
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rm 
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Weighting  Matrix 


Option  El 

ITEM  IQA 

ITEM  5A 

ITEM  ZB 

-2 

-4 

-6 

1  1  T  lOctksfi  yi 

1  1  1  lObCiph  B 

E  1  1  ICWjan  & 

ITEM8A 

ITEM  46 

nEMIB 

-1 

-2 

-3 

1  J  r 'I  OuiKm  fi 

1  E  1  lOmlon  B 

Unlill^d 

rTEMSB 

0 

0 

0 

1  1  1  lObfinri  S 

1  1  r  tQpten  fr 

1  ^  1  lOptiin  B 

ITEiM  1UB 

ITEM  m  1 

ITEM  m 

+1 

+2 

+3 

Option  j* 

^^^^|Qptiofi  B 

ITEM7A 

ITEM4A 

ITEM3B 

+2 

+4 

+  6 
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Summary  Score  Bar  Chart 


C?  F  00 

13  F  00 

SEAI^ 

^^^10  SEAI^ 

^^^10  SEAI^ 

SEALS  are  very 
covert 

SEAL  team  has  a 
corpsman 

SEALS  are 
especially  trained 
in  hostage  rescue 

[p  p-  [^0 

1  1  1  ISEM^ 

□J  p-  [^0 

1  1  1  ISEAii 

3  p-  [^0 

1  1  1  ISEM^ 

Rebels  have  no 
night  vision 
capability 

There  will  be 
dense  fog  in  the 
morning 

SEALS  should 
spend  least  time 
on  the  island 

[p  p-  1^0 

13)  p-  1^0 

3  p-  00 

1  1  1  ISEAIi 

1  1  1  ISEAii 

1  1  1  ISEAIi 

Seal  team  can  be 
activated 
immediately 

Very  small  time 
window  for 
landing  SEALS 

Injured  worker 
will  have  to  spend 

2  hours  in  Zodiac 

[p  p-  1^0 

13  p-  1^0 

3  p-  1^0 

1  1  1  ISEM^ 

1  1  1  ISEAi^ 

Reef  is  only 
passable  at  high 
tide 

SEALS  have  just 
returned  from 

■annfttickr  mic-c-inn 

Seal  team  does 
not  have  a 
translator 

3  F  00 

3  F  00 

3  F  00 

Army  unit  has 
trained  on  island 
and  knows  terrain 

^^■0  Amy 

Armyteam  has 
corpsman  and 
translator 

1  1  1  l^v 

Use  of  Army  will 
have  least  impact 
on  our  reserve 

3  p-  [^0 

3  p-  [^0 

3  p-  [^0 

1  1  rnAmy 

1  1  riAmy 

1  1  riAmy 

Armyteam 
predicted  to  have 
least  casualties 

Use  of  Army 
would  have  good 
public  relations 

Army  will  have 
the  most 
firepower 

3  p-  00 

3  p-  00 

3  p-  00 

1  1  rnAmy 

1  1  riAmy 

1  1  riAmy 

Army  unit  is  very 
fresh  and  at  full 
strength 

Off-road  terrain 
difncultfor  Army 
vehicles 

Army  will  be  the 
most  expensive 
option 

3  p-  1^0 

3  p-  1^0 

3  p-  1^0 

Bridges  on  roads 
do  not  have  high 
load  capacity 

Army  response 
will  not  be  covert 

Army  will  have 
the  slowest 
response  time 

Algebraic  sum 
of  all  lOBs  for 
each  option. 
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Sample  DCODE  Summary  Results 


Multiple  Options 


Single  Option 
(Yes-NO,Aet-Don’t  Aet) 


Two  Options 
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Development,  Inc.  (RED-Inc) 


Short  AVI  on  DCODE  use 


(2  min  40  sec) 


DCODE  Process 


Research  &  Engineering 
Development,  Inc.  (RED-Inc) 


Best  ETA  for 
SEALS  is  1900 
hrs,  10/14 

[p  p-  [^0 


Nov-21-05  11:33Ay1  G... 
Fleming 

ETA 


•Option 

•Importance 

•Impact 


Abstract 


Encapsulate 

•Option 
•Importance 
•Impact 
•Quality 


Integrate/Sort 


Assess 


Best  ETA  for 
SEALS  is  1900 
hrs,  10/14 


I  I  I  l-h  SEALS 
Nov-21-05  ll:43Ay1  G.. 
Fleming 

ETA 


Share 


Decide 
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Experiments  (Planned/Completed) 


NEED  YOUR  HELP! 


Research  &  Engineering 
Development,  Inc.  (RED-Inc) 


Research  Question: 


Does  the  use  of  the  DCODE  Assessment 
bar  improve  decision  making  quality? 

Decision  Task:  Rank  order  three  candidate  cities  (A,  B  and  C) 
in  terms  of  preference  as  a  location  for  a  new  store. 

1 2  information  items  about  each  city. 


Research  &  Engineering 
Development,  Inc.  (RED-Inc) 


2-Group  Design 

Text  vs.  DCODE  Bar 


Text  Group 


Very  High  Importance 
Very  Positive  Impact 

1  1  1  1  Option  A 

Item  17 

Very  High  Importance 
Very  Negative  Impact 

1  1  1  1  Option  A 

Item  10 

High  Importance 
Positive  Impact 

1  1  1  1  Option  A 

Item  32 

High  Importance 
Negative  Impact 

1  1  1  1  Option  A 

Item  9 

Average  Importance 
Very  Positive  Impact 

1  1  1  1  Option  A 

Item  25 

Average  Importance 
Positive  Impact 

1  1  1  1  Option  A 

Item  7 

Very  High  Importance 
Positive  Impact 

I  I  I  I  Option  A 

Item  29 


High  Importance 
Very  Positive  Impact 

I  I  I  I  Option  A 

Item  4 


High  Importance 
Negative  Impact 

I  I  I  I  Option  A 

Item  13 


High  Importance 
Negative  Impact 

I  I  I  I  Option  A 

Item  16 


Average  Importance 
Positive  Impact 

I  I  I  I  Option  A 

Item  1 


Average  Importance 
Negative  Impact 

I  I  I  I  Option  A 

Item  11 


Functionally 

equivalent 


DCODE  Group 


Option  A 

Item  17 


I  I  I  I  Option  A 

Item  29 


Option  A 

Option  A 

Item  10 

Item  4 

1  1  1  1  Option  A 

1  1  1  1  Option  A 

Item  32 

Item  13 

1  1  1  1  Option  A 

1  1  1  1  Option  A 

Item  9 

Item  16 

1  1  Option  A 

1  1  1  1  Option  A 

Item  25 

Item  1 

1  1  1  1  Option  A 

1  1  1  1  Option  A 

Item  7 

Item  11 

T  ext  Group 
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Instructions  Sorted  by  Impact 


Very  High  Importance 
Very  Positive  Impact 

High  Importance 

Very  Positive  Impact 

Very  High  Importance 
Very  Positive  Impact 

Average  Importance 
Very  Positive  Impact 

Very  High  Importance 
Very  Positive  Impact 

High  Importance 

Very  Positive  Impact 

1  1  1  1  Option 

1  1  1  1  Option 

1  1  1  1  Option  B 

1  1  1  1  Option  B 

1  1  1  [Option  C 

1  1  1  1  Option  C 

Very  High  Importance 
Very  Positive  Impact 

Very  High  Importance 
Positive  Impact 

1  1  1  1  Option  A 

1  1  1  1  Option  A 

Item  17 

Item  29 

Very  High  Importance 
Very  Negative  Impact 

High  Importance 

Very  Positive  Impact 

1  1  1  1  Option  A 

1  1  1  1  Option 

Item  10 

Item  4 

High  Importance 
Positive  Impact 

High  Importance 
Negative  Impact 

1  1  1  1  Option  A 

1  1  1  1  Option  A 

Item  32 

Item  13 

High  Importance 
Negath/e  Impact 

High  Importance 
Negath/e  Impact 

1  1  1  1  Option  A 

1  1  1  1  Option  A 

Item  9 

Item  16 

Average  Importance 
Very  Positive  Impact 

Average  Importance 
Positive  Impact 

1  1  1  1  Option  A 

1  1  1  1  Option 

Item  25 

Item  1 

Average  Importance 
Positive  Impact 

Average  Importance 
Negative  Impact 

1  1  1  1  Option  A 

1  1  1  1  Option  A 

Item  7 

Item  11 

Very  High  Importance 
Very  Positive  Impact 

Very  High  Importance 
Very  Negative  Impact 

1  1  1  1  Option  B 

1  1  1  1  Option  B 

Item  20 

Item  30 

High  Importance 
Positive  Impact 

High  Importance 
Negative  Impact 

1  1  1  1  Option  B 

1  1  1  1  Option  B 

Item  18 

Item  26 

High  Importance 
Very  Negative  Impact 


I  I  I  I  Option  B 

Item  14 


Average  Importance 
Positive  Impact 


I  I  I  1  Option  B 

Item  3 


Average  Importance 
Positive  Impact 


I  I  I  1  Option  B 

Item  6 


Average  Importance 
Negative  Impact 


I  I  I  1  Option  B 

Item  2 


Average  Importance 
Very  Positive  Impact 


I  I  I  I  Option  B 

Item  24 


Average  Importance 
Positive  Impact 


I  I  I  1 0ption  B 

Item  3G 


Average  Importance 
Positive  Impact 


I  I  I  1 0ption  B 

Item  34 


Average  Importance 
Very  Negative  Impact 


I  I  I  1 0ption  B 

Item  35 


Very  High  Importance 
Very  Positive  Impact 

Very  High  Importance 
Positive  Impact 

1  1  1  1  Option  C 

1  1  1  1  Option  C 

Item  28 

Item  19 

Very  High  Importance 
Positive  Impact 

High  Importance 

Very  Positive  Impact 

1  1  1  1  Option  C 

1  1  1  1  Option  C 

Item  15 

Item  27 

High  Importance 
Negative  Impact 

High  Importance 

Very  Negative  Impact 

1  1  1  1  Option  C 

1  1  1  1  Option  C 

Item  12 

Item  23 

Average  Importance 
Negative  Impact 

Average  Importance 
Negative  Impact 

1  1  1  1  Option  C 

1  1  1  1  Option  C 

Item  8 

Item  22 

Average  Importance 
Negative  Impact 

Average  Importance 
Negative  Impact 

1  1  1  1  Option  C 

1  1  1  1  Option  C 

Item  5 

Item  21 

Average  Importance 
Negative  Impact 

I  I  I  1  Option  C 

Item  31 


Average  Import^^ 
Negative  Impact^xp 

I  I  I  1  Option  C 

Item  33 


I  l27 

I  nportance 
1  lact 

i  n  C 

I  15 


nportance 

mpact 

I  tion  C 

[  m  33 


mportance 

mpact 

I  tion  C 
E  m22 


I  iportance 
I  npact 

i  on  C 
I  121 


[  rtance 


F#hin  Imn 


on  C 


123 


Sorted  by  Importance 


DCODE  Group 


Research  &  Engineering 
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Instructions  (includes  explanation  of  DCODE  seoring) 


Option 

1  1  1  1  Option 

Item  17 

Item  29 

]  Option 

Item  32 


I  I  I  Option  A 

Item  7 


Option 

Item  9 


]  Option 

Item  11 


Option 

Item  1 


■  Option  B 

Item  20 


■  Option  B 

Item  30 


Option  B 

Item  3 


]  Option  B 

Item  26 


I  I  I  I  Option  B 

Item  2 


Option  B 

Option  B 

Item  14 

Item  35 

■  Option  C 

Item  28 


I  I  I  I  Option  C 

Item  19 


■  Option  C 

Item  28 


]  Option  C 

Item  19 


]  Option  C 

Item  27 


I  I  I  ~l  Option  C 

Item  15 


FTT  1  1  Option  C 

1  1  1  1  Option  C 

Item  12 

Item  33 

1  1  1  1  Option  C 

1  •••'  •  1  1  1  0  pt  i  o  n  C 

Item  8 

Item  22 

I  I  I  I  Option  C 

Item  21 


I  I  I  ~l  Option  C 

Item  31 


]  Option  C 

Item  23 


Option  C 

Item  5 


Scoring  Sheet 


-Write  your  choice  as  Best 
option  on  the  ‘‘100”  line. 

-Write  your  choice  as  Worst 
option  on  the  “0”  line. 

-Circle  the  number  that  best 
represents  where  you  would 
assign  the  remaining  option. 


I  I  Male 

□  Female 


Which  did  you  think  helped  the 
most  in  making  your  decision? 


□  Sorting  by  Importance 

□  Sorting  by  Impact 

□  Both  Equal 


How  would  you  assess  your 
confidence  in  the  assigned  ratings? 


_ Very  High 

_ High 

_ Above  Average 

_ Average 

_ Below  Average 

_ Low 

_ Very  Low 


“Correct” 


Option  A  =  +6 

Option  B  =  - 1 

Option  C  =  +4 

Distance  from  Worst  to  Best 

Option  C  is  5/7  of  the  way 


Research  &  Engineering 
Development,  Inc.  (RED-Inc) 


Response 


100  Option  A 

90 

Option  C 


50 

40 

30 

20 

10 

0  Option  B 


7 

71% 
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Subject  gets  4-sheet  booklet: 


Scoring  sheet 

36  lOBs  sorted  by  Impact 

36  lOBs  sorted  by  Importance 

Instructions 

Request  to  you... 


Research  &  Engineering 
Development,  Inc.  (RED-Inc) 


I  send  you  DCODE 
test  material 


You  collect  responses,  send 
back  in  enclosed  mailer 


Research  &  Engineering 
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Technology  Demonstrations  Planned 


In  Progress: 

•  Human  Systems  Performance  Assessment  Capabilities  (HSPAC) 
Possible: 

•  Composable  FORCEnet 

•  Trident  Warrior 


Expeditionary  Strike  Group  1  (ESG-1) 


Research  &  Engineering 
Development,  Inc.  (RED-Inc) 


The  Human  Systems  Performance  Assessment  Capability  (HSPAC) 


•The  Human  Systems  Performance  Assessment 
Capability  (HSPAC),  is  a  Navy  infrastructure  that  will 
allow  individual  and  system-level  human  performance 
to  be  assessed  and  certified. 

•  The  Usability  and  Engineering  Research  Lab  and  the 
Composeable  FORCEnet  Human  Systems  Integration 
(CFnHSI)  Lab  in  Point  Loma,  Calif.,  will  be  a  key  part 
of  this  distributed  capability. 

•  HSPAC  will  enhance  fleet  readiness  and  operational 
effectiveness  at  the  lowest  total  ownership  cost  by 
providing  personnel,  expertise,  equipment,  connectivity, 
tools,  models,  environments  and  alliances  necessary  to 
measure,  analyze,  assess  and  certify  Sailor  performance 
in  warfighter  systems  across  all  life-cycle  phases. 


Research  &  Engineering 
Development,  Inc.  (RED-Inc) 


Composeable 


FORCEnet  (CFn) 


A  major  goal  of  Composeable  FORCEnet  Is  to 
provide  mechanisms  to  transform  information  into 
knowledge  in  a  manner  that  directly  supports 
decision  making  at  ali  leveis  of  command  in  a 
Joint  and  combined  warfighting  environment. 

Grand  CFn  Challenges 

•  Technical  Challenges 

o  Reality  of 'Open  Systems” 

o  Multi-level  Security  and  Iiiformatioii  pedigree  and  trust  issues 
o  Network  Access,  Bandwidth,  Latencies,  QOS 
o  Computing  Infrastructure 

o  Situation  Awareness  /  Decision  Suppoit  (Cognition)  Development,  and 
Application  of  Modeling  and  Simulation 


Research  &  Engineering 
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Technology  Demonstrations  Planned 
(Intelligence  Community) 


“Is  Carlos  still  in  Columbia?” 
(situation  assessment) 


1  1  1  lln  Columbia 

1  1  1  1+  In  Columbia 

1  1  1  1  In  Columbia 

Money  Account 
Actiuity 

Madrid  Airport 
photo 

Message  traffic 
wJMiami 

1  1  1  lln  Columbia 

1  1  1  1  In  Columbia 

In  Columbia 

Family  has  been 
moved 

Death  of  Juan 
Potero 

Cuba 

informant  6/17 

“Where  is  Carlos?” 
(option  seleetion) 


I  I  I  IRc-me 

Spanish 

Immigration 

I  I  I  I  London 

Interpol 

phonecon 

Memo  from 

NSA 

Rome 

I  I  I  IMadrid 

I  I  I  I  London 

Miami 

Interpol 

Informant 

informant 

phonecon 

in  New  York 

BUn  Rorne 

I  I  I  l^ytadrid 

I  I  I  I  London 

Italian 

DEA 

Interpol 

Customs 

data  search 

phonecon 

I  I  I  IRcme 

I  I  I  IMadrid 

London 

Rome  Airport 

Photo 

Pasport 

Security 

Analysis 

records 

/  /I 


/■  / 

7 

1/r 


Madrid  London  Rome 
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Expected  Final  Products 


•  Shrink  wrapped,  robust  version  of 
EWall/DCODE  software 

•  Detailed  User’s  Manual  (PDF  format) 

-  Supporting  AVI’s 

•  Research  results  demonstrating  the  efficacy 
of  DCODE  as  a  decision  support  tool. 

•  Briefs/support/transitions  to  candidate  user 
community 


Research  &  Engineering 
Development,  Inc.  (RED-Inc) 


#1  Priority  DCODE  Software  Enhancement 


Option  to  Select  (in  Exchange  View)  Summary  Score 

display  for  all  participants 


Reaching  Consensus: 
Where  are  the  critical  differences? 


Research  &  Engineering 
Development,  Inc.  (RED-Inc) 


Jones  Smith  Baker 


12  items  for 
Option  A 


r  - 


Secondary 


C?  00 

I  I  I  I  Option  ^ 

Item  1 


C?  00 

I  I  I  I  Option  ^ 

Item  2 


C?  00 

I  I  I  I  Option  ^ 

Item  1 


0  00 

I  I  I  I  Option  ^ 

Item  2 


Here  are  the 
critical  assessment 
differences: 
focuses  group 
discussion  on  the 
two  main  items 
creating  conflict  and 
preventing  consensus. 


These  feature  is  not  yet  available 


Research  &  Engineering 
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Planned  Publications 


“Quantification  of  subjective  information  assessments  in  C2 

decision  option  selection” 


Cowen,  M  and  Fleming,  R.  Paper  accepted  at  Command 
and  Control  Research  and  Technology  Symposium,  San 

Diego,  June  14-17,  2006. 
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Project  Presentation 


Research  &  Engineering 
Development,  Inc.  (RED-Inc) 


•  Focus  of  project  presentations  is  the  technical  exchange  of  ideas  in 

collaboration  and  knowledge  management. 

•  At  a  minimum,  the  following  topics  should  be  addressed  in  the  presentation: 

1.  Project  Title  /  Research  Team  Members 

2.  Overall  Objectives  and  this  yearns  Objectives 

3.  Research  Questions  Addressed 

4.  Technical  Approach 

5.  Experiments  (Planned/Completed)  and  Results  (if  available) 

6.  Technology  Demonstrations  Planned 

7.  Expected  Final  Products/where  to  be  used 

8.  Identify  Recent  or  Planned  Publications 


•  Presentation  Time:  30  minute  brief,  10  minute  Q&A 


